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ABSTRACT 

American college students (N=46) were asked to assign 
grades to a series of words and phrases used in describing college 
work. The variables of sex. CPA and cognitive/semantic consistency 
were correlated with 30 descriptor words. The re5>ults revealed that 
the first canonical root was significant. Using regression to explore 
individual patterns, it was found that all three independent 
variables of sex, self-reported grade point average, and 
cognitive/semantic consistency affected the grades thought to be 
associated with the descriptors. Males perceived, the wood *'poor" to 
be significantly more positive than did females. Higher grade point 
averages led to a more positive evaluation of the words "graduate 
quality." Finally, "poor," "outstanding," and "passing" were all more 
favorably rated by those who exhibited greater cognitive/semantic 
consistency. What is abundantly clear from these data is that the ^ 
words used to describe achievement in a college classroom are subject 
to systematic confusion depending on gender, CPA and 
cognitive/semantic consistency of the receiver/students. Given the 
sample size for this study (42 respondents), the trends in these data 
portend differences which could only be called gigantic. This line of 
research should be further pursued. (A table is included. Contains 
six references .) (Author/TB) 
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Abstract 



Amencan college students (N = 46J were askec 'co assign 
graces to a series of worcs and pnrases used in describing 
college work. The variables of sex, GFA and cognitive/semantic 
consistency were cor^^elated with 30 descrioLor words. The 
results revealed the first canonical root was significant ( = 
.977: Eigenvalue = 20.86; AoDroximate F = 2.22; of = 33.79; o < 
,005). Using regression to explore mdiviaual oatterns, -it was 
•round that all tnree indeoendent vanaoles of sex, self-reported 
grade oomt average and cognitive/semantic consistency af-i^ected 
the grades thought to be associated with the cescriotors. Males 
oerceived tne word "poor" to be significantly more positive than 
aid females. Higher grade point averages lead to a more positive 
evaluation of tne worcs "graduate quality." Finally, "Dccr," 
"outstanding" and "oassing" were all more favoraoly rated by 
those WHO exmbited greater cognitive/semantic consistency. 



WHAT DO GRADES MEAN?: 
A PILOT STUDY USING SEX, GPA 
AND COGNITIVE/SEMANTIC CONSISTENCY 
One of zne favorite story lines in science fiction concerns 
a tyoical American male seen at the beginning of a -lyDical day. 
He arises and moves to tne breaKfast taole where his wife 
casually asks if he would like another oiece of "zeora." he 
resoonds "zeora?" Holaing a piece cf toast, sne says in a matter 
of ^'act tore cf voice "Yes, zeora." Before leav-ng for work, 
'^is small daughter announces tnat she has learnec to reac a new 
wora. The girl ooens her orimer revealing a Diccure of a cow. 
Under the cow 13 orinted the wore "Neverthe r ess . " proualy, the 
girl says "See Dacdy, nevertheless." Over the next few weeks 
the world begins to subtly change in front of our eyes. It is 
almost as if tne mean^.ngs in a cictionary have oeen dumoea into 
one box and all the words have been Gumoea into ar-cther box. 
Randomly, the meanings are drawn from tne f-rst box and assigned 
to another random araw from the G-icond box. By tne end of the 
story, the man is bei^^^ taught to speak this new language. 

But suDDose this story is not as fictional as we mignt 
"hink. Is It possible that misunderstandings of precisely this 
•:.ort are not only possible but that they are frequent? This 
general auery is the driving force behina tms study. 
pyery_iew 

In the theoretical sense what does it mean when we say that 



"we commum cate? " One way to answer that question i s * "Co realize 
that, ccmmumcaticn begins w"itn the process of perceooion. 
Communication rests on the assignation of observable pnenomenon 
into categor'^es of meaning. When we visit a home and sit down ai: 
the taole for a meal, it is immaterial tnat a disn is being 
servec wnicn we nave never before eaten. When the bowl is 
passed, we are capable of inferring tnat the contents of the bowl 
are meani: to oe eaten. We have assigned an occurrence (something 
is in tha"c cowl oeing passed to me) to a meaning category (I 
snoula orobaciy out some on my plate). 

On the ether hand, communication between "cwo oeoole is ncz 
comclete unt: 1 and unless the other person nas received ana 
interpreted m a reasonably similar fasnion that whicn we 
intended to transmit. We might even say that commum cation is 
tne coor 1 entati on of two persons seeking to arrive at a common 
set of ccgn^.tive categorizations. The degree to wnicn one 
person's assignation of a phenomenon into a category is the same 
as the other person's assignation of the same phenomenon into tne 
same category is the degree to which the two Persons are said to 
understand each other. Where then does communication go wrong? 

Perhaps the bejt way to begin is to recognize tnat 
communication problems are unlikely to occur unless the matter at 
nand is one of concern for both parties. In a social situation 
for example, if another person utters some sequence of woras 
which seem unintelligible, we are likely to ignore znem unless 



the wcras nave some sort of re'.evance for us. It is imDOlite to 
oress another too much on quest":ons of semantics ana oerhaos s/he 
will make furtner comments which will clarify the intendea 
meaning wi'^.houi: exDosing the fact tne we nave no "idea what is 
being discussea. In polite social situations tnis passive 
solution orocabiy works rather well. In more involving 
encounters, more direct action may oe reauired. 

Suooose we have a situation in wnch cne person contends 
tnat a ohencmenon belongs in one category wnile tne otner 
cor.tenGS tne same pnenomenon belongs in a cifferent category. 
Moreove'", the classification of ::his pnenomenon ^s a matter of 
concern to cotn. This aescription is, of course, a perfect 
example of tne dispute m which the stucent contends a suomittea 
oaoer 13 an 'A" while the professor contencs tnat tne same "oaper 
IS a "B". Seating asiae the issue of who wins ana wno loses, 
the aiscute is worth examining further. Is the aisagreement 
really about the paper or is it about a much more funaamental 
matter? Could it be that the student and the professor are 
actually disagreeing over what constitutes the appropriate 
phenomenon to be classified into the categories of "work to be 
considered an A" and "work to be consiaerea a B"? If this is 
the real basis for the dispute, the paper is an almost trivial 
concern. Seen in this light, the dispute depenas cn tne 
conceptual parameters of the category systems for the two 
parties. Once the categories have been defmea, tne 
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classification of t.he oaper is routine. 
P s St . jre s ear en 

It IS a Dit suronsmg that more researcn has not been 
conaucted concerning the connotative meanings of grades for 
Suucents. As early as 1 976 McKeachie oublished a rationale wh'^cn 
emphasizea, in aart, that grades are a form of communication. 
Moreover, he clearly identified an imolication of tne position 
that grades are communication by assert-'ng -chat wnat a teacher 
communicates will c.rect'y deoenc on tne rreanmg o-^^ tne grade to 
tne oe^son rBce^'v^nc the grace ^Mc.\eacni6, 1 976;. Scant 
atten^^cn seems to have been ci reeled towards this auest:on of 
1 nd VI dua I mean i ngs . 

Using a semantic differential for measurement Eiszler and 
Starcato (19^9) did discover that students appear to have at 
"east four iraeoenaent dimensions on wnicn grades are 
categorized: evaluation, realism, ccmolexity and salience. 
Later, Eiszler and Stancato (1981^ found that the feeling when 
getting a grade of C seemed to be related to whether or not the 
course was aimed at majors or nonmajors and tnen only for the 
effort reduired. This finding was especially pronounced in the 
sciences. More insight was provided Dy Stancato ana Eiszler 
( 1983) when it wers found that college students aooear to 
categorize grades on an elastic scale. That :s, the distance 
oetween grading increments is not edua 1 , 

This last finding (Stancato Eiszler, 1983) clearly 
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suggests tnat different persons seem -co have different standards 
of categorization and the earlier study (Eiszler & Stancato, 
1981; suggests that these standards are subject to contextual 
circumstances. These two notions, adaed together, form the 
nexus for the present investigation. 

It may well be the case that STSUcents have systematically 
dirferent category systems which covary across a variety of 
dimensions. for example, given the aiffering socialization 
oatterns for males ana females we mignt suspect that the meaning 
of grades could easily covary by sex. In aaait^cn, tne fact 
remains that some students achieve acacemic success more easily 
than ao others. This consistent reinforcement must, in the long 
run, have some sort of impact on not only grades but on one's 
orientation to the entire educatignal process. Finally, tne 
aiscovery tnat the meaning of graaes is conceptua 1 i zea on an 
elastic scale is intriguing but not instructive. Is there a 
rationale which could account for this elasticity? 

In fact, these concerns form the basis for tne oresent 
investigation. The research question of this stuay 1s: do t he 
meanings for gr ade s differ by gender, ac nieved grace ooint and 
l_e y ej_ s of c o gni ti ve/semanti c consistency ? 

Method 

The present study was administered to a sample (N = 4.6) of 
American college students at a large Mid-Atlantic university as 
part of a class exercise. They were told, 
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"As you know, feedback on paoers and themes is not 
a'ways as complete as i "c mignt be. For purposes of 
this SLudy, assume "chat a paper or theme has been 
graaed anc the only mark on the assignment is a word or 
ohrase; unfortunately, the letter graae was 
acc"i cental 1 y onriitted. If you were to see eacn of the 
words I'^sted below, what letter grade would you 
anticipate would be awarded to the paper?"- 
-ci "owing these nstruct i ons , the following aescriptive 
worcs were Msted in alphabetical oraer: aocve average, aoysma i , 
aw-^ul , average, barely passing, ccnfusec, aecent, excellent, 
failing, fair, good, graduate Quality, insightful , iTieaiocre, 
missed the point, needs improvement, OK, orainary, outstanding, 
passing, poor, satisfactory, so so, sound work, sclendia, 
superior, unsatisfactory, very good, very poor anc wonderful. 

After they completed this portion of the task, the 
respondents were asked to indicate their gender and grade point. 
Coqni ti ve/se manti c consi stency 

The cognitive consistency of categorization was measured by 
observing that a number of categories could oe logically ordered. 
For example, it should be the case that: above average > average; 
satisfactory > unsatisfactory; poor > very poor; passing > 
failing; barely passing > failing; passing > barely passing anc 
very good > good. The highest possible score on tnis scale would 
be a 7 , one point being given fcr each comparison wniun matchea 
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zr\e logical oraering of the categories. Tne lowest Dossible 
score wouIg oe . a zero. The observed scores ranged from a nigh 
of 7 tc a low of 4.. The mean was 5.63 with a standara aeviation 
of .97, 

Resu 1 ts 

PernaDs the first order of business is to ascertain to what 
extent, if any, the criterion variaoles mig^z be .-^edundant. An 
examinat-.on of the correlations among the variables of 
cognitive/semantic consistency. GPA and se.< revea-ed no 
s^gn-^f lean:: correlations. Ii: woula be oremature assert that 
^hese measures are not somehow relatea to one another ouz if such 
•^el ati onsm PS go exist they are not sufficienrly powerful to 
emerge in this data set. 

I'he initial aata inspection revealed that two of the 
descr ot 1 ve variacles would be of little use. Every single 
resoonaent agreed that "failing" was an F. Since this variable 
was a constant, it was eliminated from the analysis. Further, 
the descriptor variable of "abysmal" was omitted by a fifth (9 of 
•^6 ) of the sample and it was clearly misunderstood by a good many 
others — one respondent awarded it a B. To have inciuaed this 
variable in the analysis would have been to deliberately 
introduce error variance into the stuay. It too was eliminated. 

As is typical, the computer program to perform canonical 
correlational analysis discaraed any case in whicn missing data 
was encountered. Of the 46 cases, 4. were eliminated leaving an 
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effective samole size of 42. All calculations are oased on this 
N. 

Armea witn this knowleage, the 28 remaining descriotors were 
subjected to canonical correlational analysis using the criterion 
variaoles as the dependent set ana the descriptor vanaoles as 
tne inaeDenaent set. The results revealed only -r;e first 
canonical root was significant ( = ,377; Eigenvalue = 20.86; 
i^Dproximate p = 2.22; dl = 33.79; d < .005). 



Insert Taol e 1 abcut: here 



Several writers have been critical of the prac~:ce of 
interpreting the standardized canonical coefficients as if they 
were oeta weights {Muliak, 1 972; Tuci<er & Chase, 1980). 3otn 
tnese sources have recommended that the interpretations oe made 
using the correlations of the aepenaent variaoles wit:n the 
canonical variable(s). As Muliak (1972) has pointed out, tnese 
correlations "may be interpreted as one interprets factor 
loadings"' ( pg . 422). That procedure will be followed nere. 

However, the analysis is not so easily accomplished. The 
canonical root indicates that the three independent variables are 
significantly related to the 28 descriptors in multidimensional 
soace but it does not tell tne tale of how these relationships 
function. In "cne same sense in which a significant MANOVA leads 
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zo a "dredging operation" using the univariate ANOVA, we propose 
to use a s^anaard multiole regression to uneartn tne 
re lationshiDs imbeaded in che canonical root. In acvance, onl v 
those relationships with correlations iread as: 'oaaings) of .30 
or higher will be considered. This is tne same criteria as one 
would ordinarily use in factor analytic stuay, 
5j?.9r e s SI p n analyses 

The variable of sex yieldea only a single ccr-ela^ion oefore 
*he regression ended. The aescriDtcr "oocr" was ^re cnly 
significanr. correlation -or tnis solu-::-:on (r = ,4-2: " (1,33; = 

p < .on. With -Che variable of sex codec as 1 for males 
ana 0 for females, it is clear that males oerceivec this 
aescr-^ctor as oeing s ■ gni f i cantl y more positive tnan die females. 

Reoortec grade point (GPA) also oroducea a one variable 
solution. In this case, the descriotcr "graauate Quality" 
•^as tne only significant variable in the equation [r =.30; F 
^^33 ) = 6.07; p < .02). As reported grade point increased so 
did the perceived grade awarded to the words "graduate quality." 

The richest solution was soawnea for cogn i t i ve/ semant 1 c 
consistency. This regression yielded a 6 variaole solution; 
however, only tne first three variables met the criteria of .30 
or higher using the correlations of the depenaent variables with 
the canonical variables, The first descriptor in -he equation 
was "ooor' f 3eta = .43) followea by "outstanding' (Beta = .43^. 
ana enaing with "passing" ( 3eta = . 40 j . These three variables 
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Droduced a multiole correlation which exolainec over 50% of the 
variance in cognitive/semantic consistency (R =.73: F i3,31.) = 
12 .02; D < .000 ) . 

Di scuss 1 on 

To emphasize the multivariate nafjre of these results, it 
snould ce notea oefore beginning the aiscussion tnat several 
variables having acceptable cor re 1 at i ons/ 1 oad i ngs (Table 1) diJ 
net emerge in the univariate analysis at all. Notaole among 
these were: above averaqe :.35;, good (.34;, and souna work 
(.30:. This observation suggests tr^-^t there are seme 
interactions at worK wnicn the univariate analysis is incaoaole 
of caDturmg. 

It IS also worth repeating that not one of these criterion 
variables was significantly related to either of the others. It 
IS not the case that we are exam'^ning tre same var'aoles numerous 
t 1 mes . 

The most easily exolainaole finding from tne univariate 
regression was the relationshiD of GPA to the meaning of 
"graduate quality." It seems reasonable that as a student's 
grade point increases s/he would come to realize tne meaning of 
work which might qualify for graduate level credit. 

It is also no surprise that cognitive/semantic consistency 
should emerge as the most useful criterion variable of the 
analysis. Reflection reveals that it is the sine qua non of 
misunderstand to confuse the order of passing and barely passing 
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or of above average and average. Persons who cannot distinguish 
cetween tne order of these categories could easily nave problems 
in assigning values to other categories. While only future 
research will tell, it may easily be the case that classification 
confusion of this sort may lie at the heart of many communication 
oroDlems. The most interesting oDservation concerning 
cognitive/semantic consistency is that it is virtually unrelated 
to GPA (r = -.04). In so far as GPA is a measure of one's 
caoacity for achievement, the fluidity of classification 
categories for meaning is not related to that caoacity. 

On the other hand, the reoccurrence of "poor" for both 
genaer and GPA raised the possibility tnat either males or 
•^'emales might somenow be more or less semantical ly consistent. 
This susDicion was dispelled with the observation of a 
nonsignificant relationship oetween tne two variables ir = - . > 5 ; 
p IS n.s.). The import of "poor" in tnis analysis remains, for 
the moment, clouded. 
Qoda 

What is abundantly clear from these data is the fact that 
the words used to describe achievement in a college classroom are 
subject to systematic confusion depending on the gender, GPA ana 
cognitive/ semantic consistency of the recei ver /students . This 
last sentence is all the more underscored by the fact that this 
Dilot study was based on an effective sample size of 42 
respondents. In order for the results to acnieve tne levels of 
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significance found here, rhe trends in these data portend 
differences whicn coula only be called gigantic. 3ased on these 
aata, there appears to be every reason to pursue this line of 
research. The present study powerfully supports the contention 
of McKeachie (1976) that grades are communication. The task now 
seems to lie in finding a translation in which it is possible for 
tne oarties to transfer meaning. Pernaps the science fiction 
context cescribed at tne oeginning of this oaper contains mucn 
less fiction tnan we naa imagined. 
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Table 1 

Standardized Canonical Coefficienrs anc 
correlations of descnotor variables 
with their canonical variables 



Descr "! otcrs Stancara 

Canon i 
Coef f 1 ci 

above average .41 

awful .07 

average .51 

oareiy passing .25 

confused -.15 

decent -.04 

excel 1 ent . 1 i 

f ai r - . 22 

•good -.09 

graauate quality -.05 

1 nsi ghtf ul . i 2 

mediocre -.31 

missed the point .18 



1 zed Cor re : ati ons between 

cal uescriotors and their 

ents canonical variables 

.35 
.04 
. 15 
.20 

-.06 
. 14 ■ 
.00 
.00 
.33 
.31 
. 18 
,02 

-.02 
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needs imDrovement ,26 .05 

OK -.07 .09 

orainary .03 .01 

ou"Cstandi ng -.04 -.31 

Dassing -.53 .^45 

DOor -.33 «^30 

sati sf actor y ,08 -.15 

30 so ,04 ,15 

souna work .08 ,28 

SDlendid ,79 ^09 

superior -.14 -.10 

unsatisfactory .42 .14 

very good -.73 -.23 

very poor .13 .23 

wonderful .01 -,08 
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